Instability in a Network Coevolving with a Particle System 
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We study a coupled dynamics of a network and a particle system. Particles of density p diffuse 
freely along edges, each of which is rewired at a rate given by a decreasing function of particle flux. 
We find that the coupled dynamics leads to an instability toward the formation of hubs and that 
there is a dynamic phase transition at a threshold particle density p c . In the low density phase, the 
network evolves into a star-shaped one with the maximum degree growing linearly in time. In the 
high density phase, the network exhibits a fat-tailed degree distribution and an interesting dynamic 
scaling behavior. We present an analytic theory explaining mechanism for the instability and a 
scaling theory for the dynamic scaling behavior. 
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For the past decade growing interests have been paid 
to complex networks. They are ubiquitous in nature 
and display intriguing properties which have not been 
observed in periodic lattices or random networks. The 
work of Ref. [l[ triggered extensive and intensive studies 
on structure and dynamics of complex networks [1, S 0] • 
Dynamics and cooperative phenomena in various systems 
defined on networks have also attracted a lot of atten- 
tion 0, Q . Most studies so far have considered dynamics 
of networks or dynamics on networks separately. The aim 
of the present work is to investigate emerging structure 
of a network coevolving with a dynamical system. 

Properties of dynamical systems or models for coop- 
erative phenomena are strongly affected by underlying 
network structure. For instance, the study on random 
walks 7] shows that the density of diffusing particles at 
nodes is strictly proportional to the degree of nodes and 
that the mean first passage time is determined by the net- 
work structure through the so-called random walk cen- 
trality. Importance of underlying network structure is 
also shown in the study of critical phenomena con- 
densation [8j , opinion dynamics [9j , and so on. 

Just as network structure affects dynamics on it, the 
former may also be influenced from the latter. The 
synaptic plasticity is an example of such phenomena • 
In neural networks, bio-chemical signals are transmitted 
from neuron to neuron through synaptic links. At the 
same time, the strength of synapses can be enhanced or 
suppressed depending on synaptic activities. It is called 
the synaptic plasticity, which may result in deformation 
of neural networks. 

When structure and dynamics are coupled, the inter- 
play between them will drive a network to evolve in a 
self-organized way. It is challenging to study the emerg- 
ing property of such a network. We will show that the 
interplay can lead to an instability toward the formation 
of hubs. There are a few recent works on cocvolution- 
ary dynamics of complex networks. Network dynamics 
combined with a game theoretical model was studied in 
Refs. [3, El, and that combined with a voter model type 



opinion dynamics was studied in Refs. [HQ. However, 
the dynamic instability was not observed in those studies. 

We study a minimal model which consists of a network 
and diffusing particles. A network is undirected and con- 
sists of N nodes. Each edge e = between nodes 
i and j is assigned to a positive weight w e . There are 
particles of density p distributed over nodes. We adopt 
the following dynamic rule: (i) All particles hop to their 
neighboring nodes randomly and independently, (ii) If a 
particle hops from node i to j, the weight of all edges at- 
tached to j is increased by unity, (iii) After the hopping 
of all particles, each edge e is rewired with the proba- 
bility l/w e . The weight of rewired edges is set to unity. 
The time is increased by unity after those processes. 

The diffusion (i) mimics a transport taking place on 
a network. For simplicity, the particles are taken to be 
non-interacting. According to (ii), the weight w e of an 
edge e = established at time t e is given by 



w e {t) = l+J2 MO + "i(0)- 



(1) 



Here, rii(t') denotes the number of particles visiting node 
i at time t'. The more an edge contributes to a trans- 
port the more robust it is [HI] . Less important edges are 
weeded out and replaced by new ones in the process (iii) . 

We start with a random network with N nodes and 
mean degree (k) over which particles of density p are dis- 
tributed randomly. The weight of all edges are set to 
unity. Then we measure the degree k max of the node 
having the largest degree and the degree distribution 
Pdeg. (k), which are averaged over N$ samples. The mean 
degree is fixed to (k) — A and TVs = 10 3 in numerical 
studies. 

Figure [T] shows the numerical data for k max with 
N = 1000. One finds that k max increases in time exceed- 
ing the value k max = 0(lnN) which one would expect in 
random networks at all values of p except 0.1. This sug- 
gests that there exists a dynamic instability toward the 
formation of hubs. Initially all edges have low weights 
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FIG. 1: Time evolution of k max in networks with N = 10 



and they are rewired randomly at a constant rate. Sup- 
pose that a node i happens to be linked with more edges 
than others due to a statistical fluctuation. Then it will 
be visited by more particles since diffusing particles tend 
to be attracted toward higher degree nodes [tJ • This will 
strengthen the edges emanating from i, and the node i 
will have more chance to increase its degree. This feed- 
back may be a possible mechanism for the instability. 
This idea will be elaborated in detail later. 

The numerical data in Fig. [T] also suggest that there is 
a dynamic phase transition at p = p c ~ 0.6. The thresh- 
old will be estimated from a scaling theory which will be 
presented later. When p is small (see Fig.QJa)), k max re- 
mains almost constant up to a certain time scale r. Then 
it grows ballistically as k max ~ t until it reaches the lim- 
iting value k max ~ N . We will call r the instability time. 
More detailed information is obtained from the degree 
distribution presented in Fig. [2^a). It follows the Pois- 
son distribution for t <C T, which indicates that all nodes 
are statistically equivalent and edges are being rewired 
randomly. At t ~ r, a hub emerges spontaneously devel- 
oping a peak in the degree distribution. The hub grows 
until it is connected to almost all other nodes. Finally 
there is an isolated peak in the degree distribution and 
the network becomes star-like. 

The system exhibits distinct behaviors when p is 
large (see Fig. QJb)). The instability sets in immediately 
and then k max increases sublinearly in time, whose time 
dependence has not been characterized yet. The numer- 
ical data in Fig. [2b) show that the degree distribution 
remains continuous and keeps broadening. These behav- 
iors allow us to interpret that hubs emerge simultane- 
ously and compete with each others to grow into larger 
ones. During the growth, the degree distribution can be 
fitted into the power-law form as Pdeg.{k) ~ fc~ 7 with 
7 ~ 2.0. The power-law degree distribution persists for 
a long time, but is not a stationary one. The numerical 
data show that there appears a dip in the intermediate k 
regime. It suggests that a single hub will dominate and 
the network will become star-like eventually, which we 
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FIG. 2: Time evolution of the degree distribution of the 
networks with N = 10 3 and with (a) p = 0.2 and (b) 
p = 1.0. The solid curves represent the Poisson distribution 
Pde g .{k) = e~ (k) (k) k /k\ with (k) = 4. The dashed line in (b) 
has the slope — 2. 



could not observe numerically up to t — O(10 7 ) though. 

We present a phenomenological theory that explains 
mechanism for the instability. On a non-evolving com- 
plex networks, a diffusing particle relaxes quickly to the 
stationary state in which the visiting frequency to a node 
is strictly proportional to its degree 0] • Using this prop- 
erty, we assume that the diffusing particles remain in the 
quasi-stationary state to a given network at each mo- 
ment. The quasi-stationarity assumption allows us to 
make the approximation n, (t) ~ pki (t) / (k) in Eq. |1| , 
with which we can eliminate the particles degrees of free- 
dom. 

In order to describe the onset of the instability, it suf- 
fices to consider an effective dynamics of a single node 
/ and its degree K. Before the onset, all edges in the 
network are rewired randomly at a constant rate. So we 
can assume that K is increased (K — > K + 1) at each 
time step with a suitable choice of time unit. The weight 
w a of each edge a = 1 , ■ ■ ■ , K is set to unity when it 
is attached to L and then increased by the amount of 
Aw a = \K(t) |16( at time step t according to the quasi- 
stationarity assumption. The constant factor A should 
be an increasing function of p, whose explicit form is not 
necessary. So, the weight of an edge a having been at- 
tached to / since time t a , is given by 



(2) 



The degree K decreases when an edge a is rewired with 
the probability l/w a . Combining those processes, we can 
write down the rate equation for the time evolution of the 
mean value of the degree: 



AK EE K(t + 1) - K(t) = fin - fo 



(3) 



where the incoming flux is given by /j„ = 1 and the out- 
going flux is given by f out = J2a=i 1 /w a {t). Since the 
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FIG. 3: Graph of -^g(x) with Ai < A c ~ 2.03 < A 2 . 



weight given in Eq. @ has history dependence, the ef- 
fective dynamics for K(t) is non-Markovian. Note that 
the effective dynamics of a single node is valid only 
when edges among other nodes are rewired at a constant 
rate (/ m = 1). 

The resulting single node dynamics is analogous to that 
of a queueing model [13] • In that context, the node /, 
the edges, and the degree K correspond to a queue, data 
packets, and the queue size, respectively. Hereafter, we 
will adopt the terminology of a queueing model for the 
single node problem. Such a correspondence between net- 
work dynamics and particles dynamics was also consid- 
ered in the context of a zero-range process [3] • 

Suppose that there are K packets in the queue at time 
t. We denote by t a (a = 1, • • • , K) the time at which 
a packet a entered the queue. Labeling the packets in 
such a way that a < a' implies t a < t a i, one has the 
inequality K(t a ) > a. It yields 



K 



w a > 1 + X a', 



(4) 



which imposes an upper bound on the outgoing flux 
font < Font (K, A) . A straightforward algebra shows that 



F out (K,X) = -^=g(VXK), 



where 



In 



c 2 + 2 + x^Jx 2 + 2 



(5) 



(6) 



The shape of this function is drawn in Fig. [3] It attains 
the maximum value g c — 0.712 at x — x c — 2.64. 

Note that the function g(x) converges to zero as g(x) ~ 
| for | a; | <i c and g(x) ~ for x ^> x c . Consequently 
font (< F out ) decays to zero at sufficiently large values 
of K at any nonzero value of A while /;„ = 1. It implies 
that the queue size will diverge in the long time limit. 
However, dynamic features may be different depending 



on the value of A: (i) When A > A c = {2g c ) 2 ~ 2.03, 
AK = f in — f out > for all values of K. Hence the queue 
size K (t) grows immediately and asymptotically linearly 
in time, (ii) When A < A c , there may be a dynamic 
barrier in an interval K\ < K < K2 where AK < 0. In 
that case the queue can be trapped to an attractor at 
K (t) = K\. It, however, cannot stay there permanently 
because the queue can escape from the barrier due to 
a statistical fluctuation in a characteristic time scale r. 
For t > r, the queue size K(t) will grow linearly in time 
asymptotically. 

For A < A c , we can estimate the time scale r roughly. 
As a crude approximation, we regard Eq. ([4]) as an equal- 
ity so that the result r' obtained thus will provide a lower 
bound for r. The queue size increases by unity at each 
time step if no packet escapes from the queue. It happens 
with the probability P no (K, A) = ria=i(l — lA°a)- For 
large K it is approximated as P no ~ exp(— J2 a ^/ w a) = 
exp(—F out (K,X)). Thus, we can estimate the probabil- 
ity to overcome the dynamic barrier at K\ < K < K2 as 
Pesc(X) = TIkLk! [exp(-F out (X, A))] and the time scale 
as t' — l/P esc .(X). Using Eqs. (0) and ©, we obtain 
that 



exp 



a(lnA) 5 
A 



(7) 



with a constant a. 

Using the knowledge from the effective single node dy- 
namics, one can understand the dynamic property of the 
original model. We first consider the small p case (cor- 
responding to the case with A < A c ). Initially all nodes 
are trapped into the dynamic barrier. That is to say, all 
edges are rewired randomly and the degree of all nodes 
is fluctuating around the mean value (k). In the mean- 
while a certain node may escape from the barrier in the 
instability time r acquiring more and more edges. Once 
it happens, the number of particles available to all other 
nodes decreases, which leaves them into a deeper barrier. 
Consequently, the network will become star-like eventu- 
ally. This is consistent with the numerical observation 
presented in Figs. [T]and[2] A rough estimate of the in- 
stability time r is given by Eq. (|7|) with A replaced by 
p. It increases very rapidly as p decreases. It explains 
the reason why we could not observe the instability at 
p = 0.1 numerically. 

When p is large (corresponding to the case with A > 
A c ), the single node picture predicts that the degrees of 
all nodes increase simultaneously since there is no dy- 
namic barrier hindering growth. However, the simulta- 
neous growth will give rise to competition among nodes. 
One cannot apply the independent single node picture 
any more to the network dynamics. 

The quasi-stationarity condition for diffusing particles 
is still acceptable since the edge rewiring dynamics be- 
comes slower under the competition. So, the weight w e of 
an edge e will increase linearly in time as w e ~ cpt with 
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considered the rewiring dynamic of a network which coe- 
volves with diffusing particles. Our study reveals that the 
feedback between dynamics and structure can give rise to 
a dynamic instability toward the formation of hubs. This 
may be one of the origins for the broad degree distribu- 
tion observed in real world networks. We have presented 
the analytic theory explaining the mechanism for the in- 
stability. We have also presented the scaling theory with 
which one can understand the dynamic scaling behaviors 
and the dynamic phase transition of the model. 



FIG. 4: (a) Pdeg.(k) for networks of N = 10 3 nodes at several 
values of p and t with fixed t 1//p = 2 15 . (b) k max versus t 1/lp . 



a degree-dependent constant c until it is rewired. Its 
rewiring dynamics is determined by the survival proba- 
bility P s (t) which is defined as the probability that the 
edge has remained unrewired for t time steps. Up to a 
leading order, it is given by 



ft «-n('-5i 



t -l/cp _ 



(8) 



The power-law scaling of the survival probability sug- 
gests a scale invariant network dynamics in the large p 
regime. Suppose that two networks with particle density 
p and po are of a similar shape at time scale t and 
respectively. The similarity can be preserved during evo- 
lution if the survival probabilities of the corresponding 
edges are the same. Therefore, we make the scale in- 
variance ansatz that a network with the particle density 
p at time t and that with the density po at time to are 
equivalent provided that 



t = t 



p/po 



(9) 



We examine the validity of the scale invariance numer- 
ically. It predicts that the degree distribution Pd eg .{k) 
of networks with different values of p and t should be 
the same if t x l p is the same. In Fig. Eta) we present the 
numerical data for Pd eg . (k) at several values of p and t 
with fixed t 1 ^ = 2 15 . The data collapse well onto a sin- 
gle curve for p > 0.6. The scale invariance ansatz also 
predicts that the maximum degree k ma x depends only 
the scaling variable t 1 ^ . In Fig. 0Jb), we plot the data 
for k rnax presented in Fig. [1] with respect to the scal- 
ing variable t 1 / 9 . The data also collapse reasonably well 
onto a single curve for p > 0.6. From these analyses, 
we conclude that the dynamics displays the scale invari- 
ant property for p > p c and that the dynamic transition 
takes place at p c ~ 0.6. 

In summary, we have considered the coupled dynamics 
of a network and a particle system. In particular, we have 
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